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1.4.2 Law of Total Probability 

Let us start this section by asking a very simple question: In a certain country there are three provinces, call them B\ , B 2 , and B 3 (i.e., 
the country is partitioned into three disjoint sets Bi , B 2 , and S 3 ). We are interested in the total forest area in the country. Suppose that 
we know that the forest area in B\ , S 2, and S 3 are lOOfcm 2 , 50 km 2 , and 150 km 2 , respectively. What is the total forest area in 
the country? If your answer is 


100km 2 + 50km 2 + 150 km 2 = 300 km 2 , 

you are right. That is, you can simply add forest areas in each province (partition) to obtain the forest area in the whole country. This is 
the idea behind the law of total probability, in which the area of forest is replaced by probability of an event A. In particular, if you want 
to find P(A), you can look at a partition of S , and add the amount of probability of A that falls in each partition. We have already seen 
the special case where the partition is S and S c : we saw that for any two events A and S, 

P(A) = P(A n s) + P(A n B°) 

and using the definition of conditional probability, P(A (~l S) = P(A\B)P(B), we can write 

P(A) = P(A\B)P(B) + P(A\B C )P(B C ). 

We can state a more general version of this formula which applies to a general partition of the sample space S. 

Law of Total Probability: 

if b 1 ,b 2 ,b 3 ,-- is a partition of the sample space S , then for any event A we have 

P(A) = J 2 p (AnB l ) = '^P(A\B i )P(B i ). 


Using a Venn diagram, we can pictorially see the idea behind the law of total probability. In Figure 1.24, we have 

A\ = A n B\ , 

A2 = A n B2 , 

A3 = A n B3. 

As it can be seen from the figure, A\ , A2 , and A3 form a partition of the set A , and thus by the third axiom of probability 

P(A) =P(A 1 ) + P(A 2 ) + P(A3). 
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Here is a proof of the law of total probability using probability axioms: 
Proof 

Since B\ , B2 , S 3 , • ■ • is a partition of the sample space S, we can write 


5 = 

A = Ans 
= An(U i B i ) 

= U ( A flBj) by the distributive law (Theorem 1.2). 


Now note that the sets are disjoint (since the Bi 's are disjoint). Thus, by the third probability axiom. 


P(A) = p( (J(Anso) = = Y, p ( A \ B i) p i B i)- 
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Here is a typical scenario in which we use the law of total probability. We are interested in finding the probability of an event A, but we 
don't know how to find P(A ) directly. Instead, we know the conditional probability of A given some events B j, where the B \'s form a 
partition of the sample space. Thus, we will be able to find P(A) using the law of total probability, P(A) = P(A\B{ )P(B t ). 


Example 1.24 

I have three bags that each contain 100 marbles: 

• Bag 1 has 75 red and 25 blue marbles; 

• Bag 2 has 60 red and 40 blue marbles; 

• Bag 3 has 45 red and 55 blue marbles. 

I choose one of the bags at random and then pick a marble from the chosen bag, also at random. What is the probability that the chosen 
marble is red? 

• Solution 

o Let R be the event that the chosen marble is red. Let B j be the event that I choose Bag i. We already know that 

P{R\Bi) = 0.75, 

P{R\B 2 ) = 0.60, 

P(R\B 3 ) = 0.45 

We choose our partition as B\ , B 2 , B% . Note that this is a valid partition because, firstly, the Bi 's are disjoint (only one of 
them can happen), and secondly, because their union is the entire sample space as one the bags will be chosen for sure, i.e., 
P(Bi U B 2 U S 3 ) = 1. Using the law of total probability, we can write 

P(R) = P(R\B 1 )P(B 1 ) + P(R\B 2 )P(B 2 ) + P(R\B 3 )P(B 3 ) 

= (0.75) I + (0.60) + (0.45) i 
= 0.60 
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